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The invention is a flicker filter for use with video signals. The flicker filter of the invention has at least two user-adjustable inputs 
adapted to balance image quality versus flicker in the second video image. A first user-adjustable input is adapted to govern an amount of 
flicker suppression. A second user-adjustable input is adapted to govern an amount of blur, or sharpness. The two inputs are independently 
adjustable such that a user may dynamically adjust the two-dimensional system characteristics. This ability allows the circuit to be tuned 
to adjust pixel intensities where an amount of pixel intensity adjustment increases with decreassmg boundary angle, inter alia. 
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Title: TWO-DIMENSIONAL ADJUSTABLE 
FLICKER FILTER 

Background of the Invention 

The present invention relates generally to an apparatus and method for 
5 flicker filtering. More particularly, the invention relates to an apparatus and 
method for significantly reducing flicker in a video display by employing a 
two-dimensional flicker filter. 

A video image, such as that found on a television for example, is formed 
by a succession of frames projected onto a phosphorescent screen, such as that 
10 found in a cathode-ray tube ("CRT"). Multiple horizontal lines of pixels with 
many pixels per line, in turn, form each frame. 

To draw each frame, an electron beam in a CRT scans horizontally along 
each horizontal line. As it projects each pixel of a horizontal line in turn, the 
beam supplies energy to the phosphors which phosphoress, thus illuminating 
15 the pixel. The amount of energy supplied by the electron beam sets the initial 
intensity of the pixel, but the intensity pixel progressively degrades between 
scans as its phosphors give up energy in the form of light. Each pixel therefore 
acts like a small light that flickers at the frequency at which the pixel is 
scanned. 

20 However, if the frequency at which a pixel is scanned is high enough, at 

least 45 Hz, a viewer will not perceive pixel flicker. This is due to the fact that 
past this threshold, humans can not cognitively processrthe optical changes fast 
enough in order to perceive the flicker. Typical television systems typically, 
however, do not update pixels fast enough. For example an National 
25 Television Standards Committee ("NTSC") has established television and 
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video standards in the United States (in Europe and the rest of the world, the 
dominant television standards are PAL and SECAM) which defines television 
standard as a composite video signal with a refresh rate of 60 half-frames 
(interlaced) per second. A television operating on the NTSC standard then 
updates each pixel 30 times per second, or 30 Hz. Thus, a viewer can readily 
perceive pixel flicker in an NTSC format display. Phase Alternating Line 
("PAL"), the dominant television standard in Europe has a similar problem. 
' The NTSC and PAL formats use interlacing to help mask pixel flicker. 
Each frame is divided into two interlaced fields. One field includes all even 
0 numbered pixel rows while the other field includes all odd numbered pixel 
rows. When displaying a frame, all the rows of one field are scanned and then 
all the rows of the other field are scanned. Thus, two vertically adjacent pixels 
will flicker almost 180 degrees out of sync. Since the two pixels are adjacent, 
they will usually have the same or nearly the same intensity, particularly when 
15 the image does not have sharp horizontal edges. In an NTSC system, the two 
pixels will look like a single pixel flashing at 60 Hz instead of two pixels 
flashing at 30 Hz each. Since 60 Hz is above the 45 Hz threshold level for 
flicker perception, the viewer will not perceive that the two pixels flicker. 
Thus, vertically adjacent pixels tend to compensate for each other's flicker. 
20 However, an image with sharp contrasts at its edges, such as a bright 

rectangle displayed on a dark background for example, can be problematic. 
The upper or lower edge of the rectangle acts as a sharply defined horizontal 
boundary between areas of high and low intensity. For example, a row of 
pixels immediately below the horizontal lower edge of the rectangle flickers 
25 with high intensity while the row of pixels immediately above the lower 
rectangle edge flickers with little or no intensity.- Thus, the flicker of the low 
intensity row of pixels will not adequately compensate for flicker of its high 



WO 00/10326 



-3- 



PCT7US99/1782U 



intensity neighboring row, and a viewer will perceive flicker in the high 
intensity row. 

One way to reduce flicker along a horizontal intensity boundary is to filter 
the signal controlling the beam so as to reduce the abruptness with which 
5 image intensity changes in the vertical direction. A prior art 
"one-dimensional" flicker filter sets the intensity of each pixel to a weighted 
average of itself and its nearest two vertical neighbors. The intensity of each 
pixel therefore increases when a vertical neighbor is brighter and decreases 
when a vertical neighbor is dimmer. This reduces flicker because it ensures 
10 that vertically adjacent neighbors will flash with more nearly the same 
intensity. Such filtering blurs sharp horizontal intensity boundaries making an 
image appear fuzzy, but most viewers are willing to give up sharpness at 
horizontal intensity boundaries in order to reduce annoying flicker. However, 
such a flicker filter is not selective and thus, adjusts pixel intensities 
everywhere in the image, not just in areas of the image where flicker is a 
problem. This has the effect of reducing image sharpness thereby reducing 
image quality. 

Accordingly, it is an object of this invention to provide a flicker filter that 
reduces flicker in an image. 

It is another object of this invention to provide a flicker filter that 
maximizes image quality in two dimensions. 

It is still another object of the invention to provide a flicker filter that 
allows a user to selectively adjust input values to compensate for variable 
boundary conditions. 

These arid other objects of the invention will be obvious and will appear 
hereinafter. 
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Summary 

The aforementioned and other objects are achieved by the invention which 
provides a flicker filter for reducing flicker in a video signal. Often, such a 
filter is located within a television or a video scan converter. 

The flicker filter of the invention has at least mo user-adjustable inputs 
adapted to balance image quality versus flicker in the second video image. A 
first user-adjustable input is adapted to govern an amount of flicker 
suppression. A second user-adjustable input is adapted to govern an amount of 
blur, or sharpness. 

The two inputs are independently adjustable such that a user may 
dynamically adjust the two-dimensional system characteristics. This ability 
allows the circuit to be tune to adjust pixel intensities where an amount of pixel 
intensity adjustment increases with decreasing boundary angle, inter alia. 

In further aspects, the invention provides methods in accord with the 
apparatus described above. The aforementioned and other aspects of the 
invention are evident in the drawings and in the description that follows. 
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Brief Description of the Drawings 

The foregoing and other objects of this invention, the various features 
thereof, as well as the invention itself, may be more fully understood from the 
following description, when read together with the accompanying drawings in 
5 which: 

Figure 1 shows a block diagram illustrating a flicker filter system in 
accordance with the invention; 

Figure 2 shows an intensity matrix of a signal input into the flicker filter 
system of Figure 1; 

Figures 3, 4, and 5 show illustrate 3x5 weighting function matrices; 
Figure 6 shows a suitable matrix for the chroma path flicker filter; 
Figure 7 illustrates a weighting the intensity path flicker filter; 
Figure 8 illustrates a weighting provided by the filter; 
' Figure 9 illustrates a weighting provided by the filter when SHP is 0 and 0 
15 <FLK<1; 

Figure 10 illustrates a weighting provided by the filter when FLK is 1 and 
SHP is 1; 

Figure 11 illustrates a weighting provided by the filter when FLK is 1 and 
SHP is 1/2; 

20 Figure 12 illustrates a map of pixel intensities near the horizontal intensity 

boundary; 

Figure 13 shows a resulting frame image if a conventional 1-dimensional 
flicker filter weighting is applied; 

Figure 14 shows a resulting frame image if a 2-dimensional weighting is 
25 applied to Figure 10; 
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Figure 15 illustrates intensities of pixels near the vertical intensity 
boundary; 

Figure 16 shows a resulting frame image if a 1-dimensional weighting 
distribution of Figure 10 is applied to Figure 15; 
5 Figure 17 illustrates a resulting frame image if a 2-dimensional weighting 

distribution of Figure 10 is applied to the image of Figure 15. 
Figure 18 illustrates intensities of pixels near the boundary; 
Figure 19 illustrates a resulting image when the filter applies the 
1-dimensional weighting distribution of Figure 8 to the image of Figure 18; 
10 Figure 20 shows a resulting frame image if a 2-dimensional weighting 

distribution of Figure 10 is applied to the image of Figure 18; 

Figure 21 is a more detailed block diagram of the intensity path flicker 
filter of Figure 1; 

Figure 22 illustrates a weighting and summing circuit which weights and 
15 sums the 15 outputs of the shift registers of Figure 21. 
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Detailed Description 

While the present invention retains utility within a wide variety of video 
devices and may be embodied in several different forms, it is advantageously 
employed in connection in televisions or in connection with the conversion of a 
digital video signal to a television video signal, for example. In the case of 
conversion, the conversion is generally performed by a device commonly 
known as a scan converter and a flicker filter is then disposed therein. Though 
these are the forms of the preferred embodiments and will be described as 
such, these embodiments should be considered illustrative and not restrictive. 

Many of the above-described problems in displaying video signals can be 
significantly reduced and image quality can be improved if the flicker filter 
strongly adjusts intensity of only pixels for which the perception of flicker is a 
problem. Flicker is most clearly perceived only along a sharp image intensity 
boundary and, therefore, the farther a pixel is from an intensity boundary, the 
15 less likely a viewer is to perceive it as flickering. Also, there becomes less need 
to adjust its intensity and the intensity of its vertical neighbors in order to limit 
perceived flicker. Moreover, the closer an image intensity boundary comes to 
vertical, the less likely a viewer is to perceive flicker in a pixel near that 
boundary. Generally while most viewers will perceive flicker along a sharp 
20 intensity boundary that is less than 20 degrees from horizontal, few viewers 
can perceive flicker along a boundary that is more than 35 degrees from 
horizontal. Thus, when a pixel is near an intensity boundary that is more than 
20-35 degrees from horizontal, there is little need to adjust its intensity and the 
intensity of its neighbors in order to limit perceived flicker. 
25 The flicker filter therefore should strongly adjust pixel intensities when 

they are near a sharp intensity boundary that is near horizontal but should only 
weakly adjust pixel intensities along boundaries that are closer to vertical. The 
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amount of pixel intensity adjustment therefore should increase with decreasing 
boundary angle. 

In the preferred embodiment of the invention, a two-dimensional flicker 
filter is used that is user adjustable. These adjustments may be factory 
adjustments that are optimized for a specific device, a television for example, 
or may be controlled by an end user through a user interface. In the latter case, 
the user interface can be knobs or other mechanical interface. An example of a 
device that may allow such adjustability would be a scan converter where the 
scan converter is not necessarily optimized for a specific output device. 

Figure 1 is a block diagram illustrating a flicker filter system in 
accordance with the invention. The filter system has two filter paths, one for 
the luma (intensity) signal Yrs and one for the chroma (color) signals (R-Y)m 
• and(B-Y)iN. In the luma path, an analog-to-digitai ("A/D") converter digitizes 
the luma signal Y,n at the pixel clock rate to produce a data sequence Y 
15 representing intensities of successive pixels along successive rows. A flicker 
filter then filters Y to produce another data sequence Y\ A digital-to-analog 
("D/A") converter converts Y" into an output analog luma signal Yout for 
controlling pixel intensity. An image controlled by Your will have less flicker 
than an image controlled by Yin- 
20 The two chroma signals (R-Y) 1N and (B-Y) 1N are at half the frequency of 

the intensity signal Y w and are horizontally interlaced with one another so that 
they control alternate pixels along each row. In the chroma path, a 
commutating switch alternately applies each chroma signal to an A/D 
converter. After a flicker filter filters the output of the A/D converter, another 
25 commutating switch separates the flicker filter outputs into (R-Y)' and (Bg- 
color signal sequences. A pair of D/A converters then convert" them into 
(R-Y)out and (B-Y)oirr signals. 
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The flicker filter in the intensity signal path adjusts the intensity of each 
pixel in the Your signal so that it is a weighted average of itself and, in the 
preferred embodiment, fifteen of its neighboring pixels. One skilled in the art 
will recognize that the actual number of pixels which is used to create the 
weighted average is implementation specific. 

V(N,M) = A*GT(N,M) + B*GT(N,M)*FLK + C*GT(N,M)*FLK*SHP[1] 
In the above equation, Y'(N, M) is the intensity data value of filter output 
sequence Y" for the N* pixel of row M. The value GT(N, M) is the transpose 
of an intensity matrix G(N, M) illustrated in Figure 2. Referring to Figure 2, 
0 the variable Y(N, M) is intensity data value conveyed in input sequence Y for 
the N* pixel of row M. Thus, G(N, M) is a matrix of fifteen input sequence Y 
intensity data values, including the intensity at position (N, M), the intensities 
of its four horizontally nearest neighbor pixels along row M, and the intensities 
offivepixelsnearestneighborpixelsalongrowsM-landM+1. Matrices A, B 
15 and C are 3x5 weighting functions illustrated in Figures 3, 4 and 5, 
respectively. A flicker coefficient FIX and a sharpness coefficient SHP are 
scalar quantities provided as user input ranging between 0 and 1 . 

The flicker filter coefficient, FLK, governs whether the flicker filter is off 
or on. Any setting in between 0 and 1 governs an acceptable amount of flicker 
20 where closer to 1 creates greater flicker suppression. The sharpness 
coefficient, SHP, is a settable coefficient which governs an amount of blur 
which is acceptable. As SHP is adjusted towards 1, sharpness of text and 
diagonal lines are returned toward their non-flicker suppressed clarity. 

The flicker filter in the chroma path is similar to the flicker filter in the 
25 luma path except for a difference in matrix C. A suitable C matrix for the 
chroma path flicker filter is illustrated in Figure 6. The difference arises 
because the two chroma signals are horizontally interlaced. There are O's in the 
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N-l and N+l columns in Figure 6 because pixels of alternate columns are 
controlled by different chroma signals. Although color flicker is normally not 
noticeable, the chroma signals are flicker filtered in generally the same manner 
as the intensity signal to maintain the spatial correlation between intensity and 
color. 

To illustrate operation of the filter in the intensity signal path, let us first 
assume that flicker coefficient FLK = 0. Figure 7 illustrates the weighting the 
intensity path flicker filter gives to each of a 5 x 3 block of pixels when 
computing the adjusted intensity of the pixel at center position (N, M). Since 
the pixel at (N, M) has a weight of 1 and all other pixels have weight 0, 
equation [1] reduces to 

Y'(N,M) = Y(N,M)- 
Since input and output intensities are the same, the flicker filter does not 
provide any adjustment to pixel intensity when FLK=0. 

Now assume that FLK = 1 and SHP = 0. Figure 8 illustrates the weighting 
provided by the filter. In such case equation [1] reduces to 

Y'(N,M) = [1/4]Y(N,M+1) + [1/2]Y(N,M) + [1/4]Y(N,M-1) 
Here the intensity of the pixel at position (N, M) is adjusted so that it is a 
weighted average of itself and its two vertically adjacent neighbors. The pixel 
0 at (N, M) is given twice the weight of its neighbors. This is the same 
weighting that is provided by a typical prior art one-dimensional flicker filter, 

Suppose we now set SHP = 0 and 0 < FLK < 1. Figure 9 illustrates the 
weighting provided by the filter. Equation [1] reduces to the following: 

Y'(N;M) = [FLK/4]Y(NiM+l) + [1-FLK/2]Y(N,M) + [FLK/4]Y(N,M-1) 
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We see that the flicker coefficient FLK determines how weighting is 
distributed between the pixel at (N,M) and its two vertical neighbors. As FLK 
increases from 0 to 1 we decrease the contribution of the pixel at N,M and 
increase the contributions of its vertically neighboring pixels. Thus, by 
5 increasing FLK we increase the amount flicker suppression by decreasing 
differences in intensity between vertically adjacent pixels. 

Let us now set FLK = 1 and SHP = 1. Figure 10 illustrates the weight 
given to each neighboring pixel when computing Y'(N, M). If we compare 
Figures 8 and 10, we note that when SHP increases from 0 to 1, the filter gives 
10 weight to pixels that are horizontally displaced from column N. Note also by 
inspection of Figure 10 that the intensity of the pixel at (N, M) is increased in 
proportion to the intensity of each of the 10 pixels of the neighboring rows 
M+l and M-l with the contribution being largest for the pixels of column N. 
Note however that the weights given to neighboring pixels along row M itself 
15 are negative — the intensity of the pixel at (N, M) is reduced in inverse 
relation to the intensity of its horizontally neighboring pixels. Flashing is more 
apparent when all pixels along a row are bright. Thus, when SHP is high, the 
filter reduces the appearance of flashing by dimming a pixel when its 
horizontal neighbors are bright. 
20 Figure 11 illustrates the weighting the filter provides when FLK = 1 and 

SHP = 1/2. Comparing Figures 10 and 11, we see that by decreasing SHP 
from 1 to 1/2 we increase the weighting given to pixels along column N and 
decrease the weighting of pixels horizontally displaced from column N. By 
comparing Figures 7-11 we see that the flicker coefficient FLK" controls the 
25 overall amount of adjustment that -is made, to the intensity of the pixel at 
position (N, M), and particularly affects the vertical distribution of weighting 
factors. The greater the value of FLK, the greater the weight that is given to 
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pixels on rows M+l and M-l. The sharpness coefficient SHP controls the 
horizontal distribution of weighting factors. The greater the value of SHP, the 
greater the weight that is given to pixels in columns N+l, N+2, N-l and N-2. 
Assume intensity values Y range between 0 and 1. Suppose, for example, 
5 that the upper half of an image frame represented by the' Y signal is very dark 
(intensity = 0) and that the lower half of the image frame is very light (intensity 
= 1). Then a map of pixel intensities near the horizontal intensity boundary 
would appear as in Figure 12. Without flicker filtering (i.e., with a weighting 
as illustrated in Figure 7), the uppermost row of pixels of intensity 1 would 
10 appear to flicker. 

If we apply conventional 1-dimensional flicker filter weighting as 
illustrated in Figure 8, the resulting frame image would appear as in Figure. 13. 
Note that the intensity of the row of pixels above the boundary is increased 
from 0 to 1/4 while the intensity of the row of pixels below the boundary is 
15 decreased from 1 to 3/4. Since the two rows flicker out of sync, apparent 
flickering is reduced, although sharpness at the boundary is lost. 

If we now apply the 2-dimensional weighting of Figure 10, where FLK = 1 
and SHP = 1, the image would appear as in Figure 14. Note that Figures 13 
and 14 are similar. Where the intensity boundary is horizontal, increasing the 
20 sharpness factor SHP has no effect on pixel intensities. 

Suppose now that the image is dark on the left and bright on the right. 
Figure 15 illustrates intensities of pixels near the vertical intensity boundary. If 
we apply the 1-dimensional weighting distribution of Figure 8 to the image, the 
result appears as in Figure 16. Note that there is no difference between Figures 
25 15 and 16. The 1 -dimensional weighting distribution of Figure 8 (FLK = 1, 
SHP = 0) has no affect on pixels near a vertical intensity boundary. This is. 
desirable because no adjustment is needed. 
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Figure 17 illustrates the result if we apply the 2-dimensional weighting 
distribution of Figure 10 (FLK = 1, SHP - 1) to the image of Figure 15. Note 
here too, no adjustment to pixel intensity is made because it isn't needed. 

Let us now suppose that an image has a 45 degree diagonal boundary 
between areas of high and low intensity. Figure 18 illustrates intensities of 
pixels near the boundary. Figure 19 illustrates a resulting image when the filter 
applies the 1-dimensional weighting distribution of Figure 8 to the image of 
Figure 18. Figure 18 illustrates that pixels above the boundary are reduced in 
intensity by 1/4 while pixels below the boundary are increased in intensity by 
1/4. Since most observers do not perceive flicking along a sharp intensity 
boundary that is more than 20-35 degrees from horizontal, most observers 
would not perceive flickering in the image of Figure 18. Thus, the 
modification of pixel intensities seen in Figure 19 resulting from the weighting 
distribution of Figure 8 is unnecessary. In effect, the weighting distribution of 
5 Figure 8 substantially reduces pixel sharpness along the 45 degrees intensity 
boundary without providing a noticeable improvement in flicker. 

Suppose now we apply the 2-dimensional weighting distribution of Figure 
10 to the image of Figure 18. The result is shown in Figure 20. Note that in 
comparing Figure 20 to Figure 19, we see that the image of Figure 20 does not 
to make as great an adjustment to pixel intensities along the intensity boundary, 
and tends to shift the adjustment horizontally away from the boundary. The 
image of Figure 20 will have a sharper boundary. As SHP is increased, the 
filter tends to limit the amount of intensity adjustment carried out near an 
intensity boundary, particularly when the angle of the intensity boundary 
25 becomes more vertical, where flicker is less noticeable. 

A user selectively calibrates the flicker filter by initially setting sharpness 
coefficient SHP to 0 and then increasing the. flicker coefficient FLK only as 
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high as needed to reduce apparent flicker to an acceptable level. In doing so the 
user gives up some sharpness everywhere in the image. However, the user can 
regain much of that sharpness everywhere except near substantially horizontal 
intensity boundaries by thereafter increasing the sharpness* coefficient SHP. 
5 This tends to reduce the amount of intensity averaging carried out at steeper 
boundary angles where it is not needed. The higher the SHP value the more 
nearly horizontal a boundary must be before the filter begins to provide 
substantial intensity adjustment. However, if SHP is set too high, the user will 
begin to notice unacceptable flicker along intensity boundaries that are nearly 
10 horizontal. Thus, the user sets SHP to the highest level that will not result in 
unacceptable flicker. 

Figure 21 is a more detailed block diagram of the intensity path flicker 
filter of Figure. 1. The Y sequence is progressively delayed by two delay 
circuits. Each delay circuit delays each pixel data value of the Y sequence by 
15 an amount of time between updates of vertically adjacent pixel rows. The Y 
value and the outputs of the two delay circuits are applied to inputs of three 
serial-in/parallel-out shift registers. Li the preferred embodiment, each shift 
register holds five successive intensity data values. A weighting and summing 
circuit, illustrated in detail in Figure 22, weights and sums the fifteen outputs 
20 of the shift registers in accordance with equation [1] to produce the Y' data 
sequence. The chroma path flicker filter is similar to the intensity path flicker 
filter except that it implements the C weighting matrix of Figure 6. 

The invention may be embodied in other specific forms without departing 
from the spirit or essential characteristics thereof. The present embodiments 
25 • are, therefore, to be considered in all respects as illustrative and not restrictive, 
the scope of the invention being indicated by the appended claims rather than 
by the foregoing description, iand all changes which come within the meaning 



and range of equivalency of the claims are therefore intended to be embraced 
therein. 
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Claims 

The embodiments of the invention in which an exclusive property or 
privilege is claimed are defined as follows: 

1 . A scan converter having a processor, for converting a first video signal 
representing a first video image into a second video signal representing 
a second video image, the scan converter comprising a flicker filter 
having at least two user-adjustable inputs adapted to balance image 
quality versus flicker in the second video image. 

2. The scan converter in accordance with claim 1 wherein the at least two 
user selectable inputs comprise a first user selectable input adapted to 
govern an amount of flicker suppression and a second user selectable 
input adapted to govern sharpness. 

3. The scan converter in accordance with claim 2 wherein the first user 
selectable input is user adjustable to adjust flicker compensation. 

4. The scan converter in. accordance with claim 1 wherein the second user 
selectable input is user adjustable to adjust sharpness. 

5. The scan converter in accordance with claim 1 wherein the at least two 
user selectable inputs comprise a first variable adapted to govern an 
amount of flicker suppression and a second variable adapted to govern 
governs an amount of blur. 

6. A two-dimensional flicker filter for removing a flicker component of an 
input video signal comprising: 

flicker means for adjusting flicker compensation; and 
sharpness means for adjusting sharpness control. 

7. The scan converter in accordance with claim 6 wherein the flicker 
means and the sharpness means are variable. 

8. The scan converter in accordance with claim 6 wherein the flicker filter 
provide both luma and chroma filtering. 

9. The scan converter in accordance with claim 6 wherein the flicker filter 
utilizes a 5x3 flicker Tilter. 
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10. The scan converter in accordance with claim 6 wherein the flicker filter 
is convertible into a one-dimensional flicker filter with adjustable 
flicker compensation by setting the sharpness means to zero. 

11. A two-dimensional flicker filter for removing a flicker component of an 
input video signal comprising a filter adapted to adjust pixel intensities 
where an amount of pixel intensity adjustment increases with 
decreasing boundary angle. 
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